A regional perspective on the accuracy of machine learning forecasts of tourism demand based on data characteristics

Working paperIn this work we assess the role of data characteristics in the accuracy of machine learning (ML) tourism forecasts from a spatial perspective. First, we apply a seasonal-trend decomposition procedure based on non-parametric regression to isolate the different components of the time series of international tourism demand to all Spanish regions. This approach allows us to compute a set of measures to describe the features of the data. Second, we analyse the performance of several ML models in a recursive multiple-step-ahead forecasting experiment. In a third step, we rank all seventeen regions according to their characteristics and the obtained forecasting performance, and use the rankings as the input for a multivariate analysis to evaluate the interactions between time series features and the accuracy of the predictions. By means of dimensionality reduction techniques we summarise all the information into two components and project all Spanish regions into perceptual maps. We find that entropy and dispersion show a negative relation with accuracy, while the effect of other data characteristics on forecast accuracy is heavily dependent on the forecast horizon.Preprin

A geometric proxy of economic uncertainty based on the disagreement in survey expectations

In this study we present a geometric approach to proxy economic uncertainty. We design a positional indicator of disagreement among survey-based agents' expectations about the state of the economy. Previous dispersion-based uncertainty measures derived from business and consumer surveys exclusively make use of the two extreme pieces of information: the percentage of respondents expecting a variable to rise and to fall. With the aim of also incorporating the information coming from the share of respondents expecting a variable to remain constant, we propose a geometrical framework and use a barycentric coordinate system to generate a metric of disagreement, referred to as a discrepancy indicator. We assess its performance, both empirically and experimentally, by comparing it to the standard deviation of the share of positive and negative responses, which has been used by Bachman et al. (2013) as a proxy for economic uncertainty. When applied in sixteen European countries, we find that both time-varying metrics co-evolve in most countries for expectations about the country's overall economic situation in the present, but not in the future. Additionally, we obtain their simulated sampling distributions and we find that the proposed indicator gravitates uniformly towards the three vertices of the simplex representing the three answering categories, as opposed to the standard deviation, which tends to overestimate the level of uncertainty as a result of ignoring the no-change responses. Consequently, we find evidence that the information coming from agents expecting a variable to remain constant has an effect on the measurement of disagreement.Peer ReviewedPostprint (published version

Tracking economic growth by evolving expectations via genetic programming: a two-step approach

The main objective of this study is to present a two-step approach to generate estimates of economic growth based on agents’ expectations from tendency surveys. First, we design a genetic programming experiment to derive mathematical functional forms that approximate the target variable by combining survey data on expectations about different economic variables. We use evolutionary algorithms to estimate a symbolic regression that links survey-based expectations to a quantitative variable used as a yardstick (economic growth). In a second step, this set of empirically-generated proxies of economic growth are linearly combined to track the evolution of GDP. To evaluate the forecasting performance of the generated estimates of GDP, we use them to assess the impact of the 2008 financial crisis on the accuracy of agents’ expectations about the evolution of the economic activity in 28 countries of the OECD. While in most economies we find an improvement in the capacity of agents’ to anticipate the evolution of GDP after the crisis, predictive accuracy worsens in relation to the period prior to the crisis. The most accurate GDP forecasts are obtained for Sweden, Austria and Finland.Preprin

Multiple-input multiple-output vs. single-input single-output neural network forecasting

Working PapersThis study attempts to improve the forecasting accuracy of tourism demand by using the existing common trends in tourist arrivals form all visitor markets to a specific destination in a multiple-input multiple-output (MIMO) structure. While most tourism forecasting research focuses on univariate methods, we compare the performance of three different Artificial Neural Networks in a multivariate setting that takes into account the correlations in the evolution of inbound international tourism demand to Catalonia (Spain). We find that the MIMO approach does not outperform the forecasting accuracy of the networks when applied country by country, but it significantly improves the forecasting performance for total tourist arrivals. When comparing the forecast accuracy of the different models, we find that radial basis function networks outperform multilayer-perceptron and Elman networks.Preprin

Regional tourism demand forecasting with machine learning models: Gaussian process regression vs. neural network models in a multiple-input multiple-output setting”

Working paperThis study presents a multiple-input multiple-output (MIMO) approach for multi-step-ahead time series prediction with a Gaussian process regression (GPR) model. We assess the forecasting performance of the GPR model with respect to several neural network architectures. The MIMO setting allows modelling the cross-correlations between all regions simultaneously. We find that the radial basis function (RBF) network outperforms the GPR model, especially for long-term forecast horizons. As the memory of the models increases, the forecasting performance of the GPR improves, suggesting the convenience of designing a model selection criteria in order to estimate the optimal number of lags used for concatenation.Preprin

A self-organizing map analysis of survey-based agents expectations before impending shocks for model selection: the case of the 2008 financial crisis

© . This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/This paper examines the role of clustering techniques to assist in the selection of the most indicated method to model survey-based expectations. First, relying on a Self-Organizing Map (SOM) analysis and using the financial crisis of 2008 as a benchmark, we distinguish between countries that show a progressive anticipation of the crisis, and countries where sudden changes in expectations occur. We then generate predictions of survey indicators, which are usually used as explanatory variables in econometric models. We compare the forecasting performance of a multi-layer perceptron (MLP) Artificial Neural Network (ANN) model to that of three different time series models. By combining both types of analysis, we find that ANN models outperform time series models in countries in which the evolution of expectations shows brisk changes before impending shocks. Conversely, in countries where expectations follow a smooth transition towards recession, autoregressive integrated moving-average (ARIMA) models outperform neural networks.Peer ReviewedPostprint (published version

A geometric approach to proxy economic uncertainty by a metric of disagreement among qualitative expectations

Working paperIn this study we present a geometric approach to proxy economic uncertainty. We design a positional indicator of disagreement among survey-based agents' expectations about the state of the economy. Previous dispersion-based uncertainty indicators derived from business and consumer surveys exclusively make use of the two extreme pieces of information coming from the respondents expecting a variable to rise and to fall. With the aim of also incorporating the information coming from the share of respondents expecting a variable to remain constant, we propose a geometrical framework and use a barycentric coordinate system to generate a measure of disagreement, referred to as a discrepancy indicator. We assess its performance, both empirically and experimentally, by comparing it to the standard deviation of the share of positive and negative responses, which has been used by Bachman et al. (2013) as a proxy for economic uncertainty. When applied in sixteen European countries, we find that both time-varying metrics co-evolve in most countries for expectations about the country's overall economic situation in the present, but not in the future. Additionally, we obtain their simulated sampling distributions and we find that the proposed indicator gravitates uniformly towards the three vertices of the simplex representing the three answering categories, as opposed to the standard deviation, which tends to overestimate the level of uncertainty as a result of ignoring the no-change responses. Consequently, we find evidence that the information coming from agents expecting a variable to remain constant has an effect on the measurement of disagreement.Preprin

A genetic programming approach for economic forecasting with survey expectations

We apply a soft computing method to generate country-specific economic sentiment indicators that provide estimates of year-on-year GDP growth rates for 19 European economies. First, genetic programming is used to evolve business and consumer economic expectations to derive sentiment indicators for each country. To assess the performance of the proposed indicators, we first design a nowcasting experiment in which we recursively generate estimates of GDP at the end of each quarter, using the latest business and consumer survey data available. Second, we design a forecasting exercise in which we iteratively re-compute the sentiment indicators in each out-of-sample period. When evaluating the accuracy of the predictions obtained for different forecast horizons, we find that the evolved sentiment indicators outperform the time-series models used as a benchmark. These results show the potential of the proposed approach for prediction purposes.This research was supported by the project PID2020-118800GB-I00 from the Spanish Ministry of Science and Innovation (MCIN)/Agencia Estatal de Investigación (AEI). DOI: http://dx.doi.org/10.13039/501100011033.Peer ReviewedPostprint (published version

Economic determinants of employment sentiment: a socio-demographic analysis for the euro area

Working PaperIn this study we construct quarterly consumer confidence indicators of unemployment for the euro area using as input the consumer expectations for sixteen socio-demographic groups elicited from the Joint Harmonised EU Consumer Survey. First, we use symbolic regressions to link unemployment rates to qualitative expectations about a wide range of economic variables. By means of genetic programming we obtain the combination of expectations that best tracks the evolution of unemployment for each group of consumers. Second, we test the out-of-sample forecasting performance of the evolved expressions. Third, we use a state-space model with time-varying parameters to identify the main macroeconomic drivers of unemployment confidence and to evaluate whether the strength of the interplay between variables varies across the economic cycle. We analyse the differences across groups, obtaining better forecasts for respondents comprised in the first quartile with regards to the income of the household and respondents with at least secondary education. We also find that the questions regarding expected major purchases over the next 12 months and savings at present are by far, the variables that most frequently appear in the evolved expressions, hinting at their predictive potential to track the evolution of unemployment. For the economically deprived consumers, the confidence indicator seems to evolve independently of the macroeconomy. This finding is rather consistent throughout the economic cycle, with the exception of stock market returns, which governed unemployment confidence in the pre-crisis period.Preprin

Unemployment expectations: A socio-demographic analysis of the effect of news

© . This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/In this study, we evaluate the effect of news on consumer unemployment expectations for sixteen socio-demographic groups. To this end, we construct an unemployment sentiment indicator and extract news about several economic variables. By means of genetic programming we estimate symbolic regressions that link unemployment rates in the Euro Area to qualitative expectations about a wide range of economic variables. We then use the evolved expressions to compute unemployment expectations for each consumer group. We first assess the out-of-sample forecast accuracy of the evolved indicators, obtaining better forecasts for the leading unemployment sentiment indicator than for the coincident one. Results are similar across the different socio-demographic groups. The best forecast results are obtained for respondents between 30 and 49 years. The group where we observe the bigger differences among categories is the occupation, where the lowest forecast errors are obtained for the unemployed respondents. Next, we link news about inflation, industrial production, and stock markets to unemployment expectations. With this aim we match positive and negative news with consumers’ unemployment sentiment using a distributed lag regression model for each news item. We find asymmetries in the responses of consumers’ unemployment expectations to economic news: they tend to be stronger in the case of negative news, especially in the case of inflation.Peer ReviewedPostprint (author's final draft